Service for Calculation of Performance Metrics of Indoor Localization Benchmarking Experiments

This report presents the service for calculation of performance metrics of indoor localization benchmarking experiments. By performance metrics we mean point and room level accuracy of location estimation, response time and power consumption of the system under test. The service is developed in order to standardize the way performance metrics of indoor localization benchmarking experiments are calculated, to automatize the storage of metrics into specific storage service and to remove the burden of manual calculation of metrics, removing the possibility of the errors in calculations. The service provides two ways of usage, namely offline and online calculation of performance metrics. Offline calculation can be used for calculating performance metrics of a previously performed experiment, so on the set of ground truths and estimates. Contrary to that, online calculation calculates and updates metrics in a real-time, so ground truths and corresponding estimates can be provided sequentially to the service and the service will take care of calculation and updating the performance metrics in the database. The services is publicly available and easy to use only by defining a specific message and sending it on a provided HTTP URL.